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' Recent work in dynamical systems theory has shown that many properties 

Q I that are associated with irreversible processes in fluids can be understood in 

terms of the dynamical properties of reversible, Hamiltonian systems. That is, 
[ stochastic-like behavior is possible for these systems. Here we review the basic 

I theory for this stochastic-like behavior and show how it may be used to obtain 



an understanding of irreversible processes in gases and fluids. Recent, closely 
related, work on the use of kinetic theory to calculate dynamical quantities 



^ such as Lyapunov exponents is also discussed. 

o 

^ ■ I. INTRODUCTION 



^ ■ Dynamical systems theory |T|, of which chaos theory is a part, has its origins in two 

famous problems of classical physics: to find a solution for the three body problem of celestial 
mechanics , and to find a proof of Boltzmann's ergodic hypothesis for the equivalence of 
time and ensemble averages of dynamical quantities (such as the force per unit area on the 
wall of the container) for isolated systems composed of a large number of particles 0. In each 
case a great deal of progress toward an understanding of both the possibilities and difficulties 
in finding solutions to these problems has been made possible, over the past several decades, 
by the development of powerful and sophisticated mathematical and computer methods. 
These developments are well summarized in a number of excellent books and papers on 
dynamical systems theory, some of which are listed as Refs. as well as references 
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contained therein. This article is a summary of a more extensive set of notes on this subject 
developed by the author which presents these topics in a somewhat more leisurely way, 
and also contains an extensive discussion of the Boltzmann transport equation . Another 
discussion of many of these topics can be found in Ref. 0. 

The purpose of this article is to explain some of these developments and to explore 
their application to the issues that preoccupied Boltzmann, namely the foundations of non- 
equilibrium statistical mechanics, with a particular emphasis on the foundations of the 



kinetic theory of dilute gases of particles that interact with short range forces ||10 Hl^] . The 
dynamical properties of such a dilute gas are somewhat easier to understand than those for 
other states of matter since in the main, the dynamics of a particle in a dilute gas consists 
of long periods of motion free from interactions with the other particles, punctuated by 
occasional and essentially brief collisions with other particles in the gas. That is, for a gas of 
particles with short range forces, the mean free time between collisions is much longer than 
the average duration of a collision. Even for such an apparently simple system complicated 
and difficult questions arise such as: How does one reconcile the reversible equations of 
motion with the irreversible macroscopic properties of such a system, particularly as seen in 
the Second Law of Thermodynamics concerning the irreversible increase of entropy? Why is 
the Boltzmann equation, which is admittedly derived on the basis of stochastic rather than 
mechanical assumptions, so successful in predicting the properties of dilute gases, and in 
explaining the origin of the hydrodynamic properties of the gas? and so on. This article will 
try to show how such questions might be answered by chaos theory and to indicate the general 
lines of the answers, to the extent that the issues are understood at present. Our discussions 



will be based at first upon the work of R. Bowen ||T3|, D. Ruelle @,|TJ], and Ya. Sinai |jT5[, who 
are the principal architects of the modern theory of the dynamical foundations of statistical 
mechanics. Recent developments due to major contributions of many other authors will also 
be described here, with appropriate, though certainly incomplete, references to the literature 



The plan of this article is as follows: In Section 2 we will review the basic ideas of 



ergodicity and mixing for dynamical systems, and show their importance for statistical me- 
chanics. We discuss the role of systems with few degrees of freedom, such as the baker's 
map and the Arnold cat map, as systems that exhibit ergodic and mixing properties and 
serve as paradigms for the kinds of properties we would like to see in systems with many 
degrees of freedom. The examples provided by such simple systems will motivate the impor- 
tant definitions of Lyapunov exponents, Kolmogorov- Sinai (KS) entropies, and hyperbolic, 
Anosov systems which will be important for the further discussions. In Section 3 we consider 
some recent applications of ideas from dynamical systems theory to the theory of transport 
phenomena, and illustrate the role of fractal structures that are responsible for diffusion 
and other transport processes. We consider there the application of escape-rate methods to 
transport theory, as developed by P. Gaspard and G. Nicolis [1^, and the method of ther- 
mostatted dynamical systems, developed by D. Evans, W. Hoover, H. A. Posch, G. Morriss, 
and E. G. D. Cohen [Q, as well as other authors. In Section 4 we use these ideas to present 
our current understanding of the dynamical origins of the Boltzmann equation, and to show 
how this equation, in turn, can be used to calculate quantities such as Lyapunov exponents 
which measure the chaotic nature of the relevant dynamics. We conclude in Section 5 with 
a number of remarks and questions. 

This article is dedicated to the memories of T. H. Berlin, M. S. Green, M. Kac, J. Kestin, 
E. A. Mason, P. Resibois, and G. E. Uhlenbeck. 

II. DYNAMICAL SYSTEMS THEORY AND STATISTICAL MECHANICS 

We begin by recalling that classical statistical mechanics represents the mechanical state 
of a system of point particles in rf— dimensional space by a single point in a phase space of 
2Nd dimensions, F-space, whose axes represent the position and momentum in each spatial 
direction for each of the particles |T^. If we denote a point in F-space by X, then the 
Newtonian motion of this phase point over a time t from X to X^ will be described by a 
time displacement transformation St with 
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= St{X). 



(1) 



Although statistical mechanics is usually concerned with systems where is large and t 
is continuous, usually called "flows", here we will often consider simple dynamical systems 
in phase spaces of two dimensions and where the time t takes on discrete values. Such 



considering them is that they display the kind of dynamical properties that we would like 
to find in systems of more interest to physicists. In particular we would like to identify 
the important features of these simple maps which are responsible for such properties as 
ergodic behavior and an approach to an equilibrium state, and then see if such properties 
are characteristic of more general flows for more realistic models of physical systems. 



Having defined the phase space T and the time displacement operator for either contin- 
uous or discrete times, we now add a third basic quantity to our discussion, an invariant 
measure, fi{A), where A is some set in phase space. A measure /i is invariant under the 
time displacement operator St if for any set A, = fi{S^tA), i.e. the measure of the 

pre-image of A, denoted by S^tA is equal to the measure of A for any t > 0. This condition, 
that an invariant measure be constant under time evolution, is closely related to the usual 
statements in equilibrium statistical mechanics where we append to the evolution equation 
for the Liouville distribution function, p(X, t) = p(S'_t(X, 0), the requirement that p be 
independent of time. An example of the point of the requirement that t > 0, will be seen 
shortly when we consider invariant measures for one dimensional maps, which are not in- 
vertible. Well known examples of invariant measures include the volume of a set in F-space 
which defines the Liouville measure, piiA), 



low dimensional systems with discrete time steps are called "maps" The reason for 



A. Invariant Measures 




(2) 
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where the integration is over the range of position and momentum coordinates that define 
the set A in F-space; the micro canonical measure on the constant energy surface, /im.c.(^)) 
defined by 

where dVL is a surface element on the microcanonical energy surface, and 'WH is the gradient 
of the Hamiltonian H of the system with respect to all of the coordinates and momenta in 
F-space [|T9[] . 

There are a number of useful systems of low dimensionality with simple invariant mea- 
sures, as well. As they will be used in our further discussions, we describe the systems and 
their appropriate invariant measures now. We should mention that very often dynamical 
systems have infinitely many invariant measures. However of these, usually only one, called 
the natural or SRB measure, can be used to compute the type of ensemble averages used 
in statistical mechanics. The other measures are often defined on very special points or sets 
in phase space. For example, one can define invariant delta function measures on periodic 
points of the system, but these measures can not generally be used to characterize the sta- 
tistical properties of the system. In all of the disussions to follow we will assume that the 
total measure of the appropriate phase space is finite, which implies, of course, that the 
measure of any subset of the space is finite. 

The simplest map with an invariant measure is a piecewise linear, 1-d non-invertible map 
of the unit interval, [0, 1] onto itself, an example of which is the tent map illustrated in Fig. 
1. This map is given by 

Xn+l = 2Xn for <Xn < 1/2, 

(4) 

= 2(1 -x„) for 1/2 <Xn<l 
Here the invariant measure of a set such as A, fJ^{A) illustrated in the figure is its Lebesgue 
measure, or simple area, fJ^iiA). For this map the pre-image of A is the union of two sets each 
of Lebesgue measure /x;(A)/2. Note that the image of A typically has Lebesgue measure 
2fii{A), so our definition of the invariant measure, using the condition t > above allows 
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us to define such measures even for non- invert ible maps, sucli as tlie tent map. an invariant 
measure sliould be defined by considering the pre-image of A, as we did above. 

For our purposes the most useful maps will be two dimensional (2 — d) invertible maps, 
particularly, the baker's map illustrated in Fig. 2, and the toral automorphism, often called 
the Arnold cat map, illustrated in Fig. 3. [^. The baker's map is defined on the unit 
square < x,y < 1 hj the dynamical equation 





( 
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^ Vn+l ^ 
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Vn ^ 
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\ 



for < X < 1/2, and 



for 1/2 < X < 1. 



(5) 



2xn 
yn/2 ^ 

{Vn + l)/2 

This map has an invariant measure which is just the Lebesgue measure of two-dimensional 
regions on the unit square. This follows immediately from the observation that horizontal 
lengths become twice as long, but vertical lengths become one half as long. One can also 
define the inverse map in a simple way. Under the inverse map, horizontal lengths 
contract by a factor of 2, and vertical lengths become twice as long. 

Toral automorphisms, T, are defined in general by the transformation 



/ 



\ Vn+l j 



T- 



ycdj 



( \ 



mod 1, 



(6) 



where a, b, c, d are positive integers, and the determinant of the 2x2 matrix, ac — bd = 1. 
Thus a unit torus is mapped onto a unit torus, and the condition on the determinant 
guarantees that all areas on the unit torus are preserved by the mapping. For reasons to 
be clear shortly, we will restrict our attention here to so-called hyperbolic maps where the 
eigenvalues of T do not lie on the unit circle. The Arnold cat map is a particular case of 

. This is the case illustrated in Fig. 3. 



this where the matrix T is given as 



B. Ergodic and Mixing Systems 



For classical systems, the foundations of equilibrium statistical mechanics are based 
upon Boltzmann's ergodic hypothesis: The long time average of the dynamical quantities 
accessible to measurement, such as the force per unit area exerted by a fluid on the walls of 
a container, for an individual, isolated system, is equal to the ensemble average of the same 



dynamical quantity taken with respect to a microcanonical ensemble [r^|. One of the tasks 
of dynamical systems theory is to identify the kinds of dynamical systems and dynamical 
quantities for which the ergodic hypothesis can be verified. 

The first major result in this direction was Birkhoff's ergodic theorem pO| , ^ : Consider 



some dynamical function, -F(X), defined on the constant energy surface, S, that satisfies the 
condition 

J dnF(X) < oo, (7) 

where the integration is with respect to the microcanonical measure defined in Eq. (^, and 
is carried out over the whole surface. Suppose further that the total measure of the surface 
is finite. Then: (i) the time average of F, denoted by F(X) = hm^-^oo ^ lo rftF(X(t)) exists 
almost everywhere on the constant energy surface, that is, for almost every starting point 
X; (ii) The time average -F(X) may depend on the particular trajectory but not upon the 
initial point of the trajectory; (iii) The ensemble average of F is equal to ensemble average 
of F itself. That is, / dfiF(X.) = J (i/xF(X); and (iv) One can replace the entire constant 
energy surface as the region of integration by any invariant subset of non-zero measure. 
Here an invariant set is one where all points (with the exception of a subset of measure 
zero) initially in the set remain in the set during the course of their time evolution, and 
the measure of the set does not change with time. Birkhoff's theorem does not show that 
systems of physical interest are ergodic in the sense of Boltzmann because the time average 
of an integrable dynamical quantity may depend on trajectories and thus not necessarily 
be equal to an ensemble average, which is, of course, just a number. We therefore define 
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an ergodic system to be one where the time average F of any dynamical quantity F is a 
constant on the surface. For such a system the time average of F is indeed its ensemble 
average, which we denote by F, since 

j di^FCX) = F J d/j, (8) 

from which it follows that 

It should be remarked that although it is true that for ergodic systems the ensemble 
average of any integrable function is equal to its time average, the requirement of ergodicity 
may be demanding too much of the dynamical systems to which we would like to apply 
equilibrium statistical mechanics. For example, for applications of statistical mechanics we 
might restrict ourselves to a smaller class of functions for which we would need to prove the 
equivalence of time and ensemble averages, thus placing fewer demands on the dynamics. 

Over the seventy or so years since Birkhoff 's theorem was proved, a number of systems 



have been shown to be ergodic p5| , p!6| , p2| . These include simple transformations of the unit 
interval [0, 1] onto itself hj x' = x + a mod 1, (think of taking steps of length a on a 
circle of unit circumference) where a is irrational, the baker's map, toral automorphisms 
of the type described above, geodesies on surfaces of constant negative curvature, and of 
most interest for physics, billiard ball systems in two and three dimensions. These systems 
include a particle moving among a system of fixed, non-overlapping hard disk or hard sphere 
scatterers (the Lorentz gas) as well as certain systems of moving hard disks or hard 
spheres, in a box with periodic boundary conditions . The proofs of ergodicity for billiard 
systems are not at all easy(!), but billiards may be the simplest physically realistic systems 



to analyze because of the simplicity of the collisions of the particles 1^^. We will return to 
this point further on, but first we wish to develop further characterizations of the dynamical 
systems for which the methods of statistical mechanics apply. 

Gibbs took Boltzmann's ideas a step further by introducing the idea of a mixing system 
16| , [T9| , ^ . He proposed to look at an initial ensemble of mechanically identical systems all 
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with the same total energy, but with different initial conditions. Suppose the phase points 
for this ensemble are confined, initially to a set of positive measure. A, on the constant 
energy surface, S. Then in the course of time this set will evolve to a new set. At, with the 
same measure as A. A system is called mixing in the sense of Gibbs, if for any fixed set B 
of positive measure on S 

That is, a system is mixing if the time evolution of any set of non zero measure leads to the 
set being distributed uniformly with respect to the invariant measure fi over the constant 
energy surface. 

It is easy to show that the condition that a dynamical system be mixing is stronger 



than requiring that it be ergodic ||16|j20|| . That is, all mixing systems are ergodic but not 
vice versa. For example the ergodic transformation of the unit interval [0, 1] onto itself, by 
x' = X + a mod 1, for irrational a is not mixing. To see this just let A,B each be small 
connected sets of the unit interval, and consider the set Cn = An H B, the intersection of B 
with the image of A after n applications of the transformation. The limit of fi{Cn) as n gets 
large is not well defined and the set A does not get uniformly mixed over the unit interval, 
but instead moves as a rigid set without mixing. 

The mixing property of a dynamical system is even more interesting for our purposes than 
that of ergodicity, not only because mixing implies ergodicity, but also because if a system is 
mixing, then non-equilibrium ensemble averages approach their equilibrium values as time 



gets large p|,pO|. That is, if one starts with some non-equilibrium ensemble distribution on £, 
not the microcanonical one, and if this distribution is a measureable function on S, then the 
time evolution of this distribution function is governed by Liouville's equation. The ensemble 
average of any measurable dynamical quantity, F, at some time t is then determined by the 
integral of F with respect to the distribution function at time t. For a mixing system, 
this ensemble average approaches its value in the microcanonical ensemble as t approaches 
infinity. Physically this means that in a weak sense, that is, under integration with some 



well behaved function , non-equilibrium distribution functions approach the microcanonical 
equilibrium distribution in the long time limit. This is the essential information needed for 
the validity of non-equilibrium statistical mechanics. 

Systems that have been rigorously proved to be mixing include the baker's map, the 
hyperbolic toral automorphisms, and the Lorentz gases described above [0,^,^ . There is 
little doubt the moving hard sphere, or hard disk systems are mixing, but as yet there is no 
rigorous proof of this supposition. 

C. Dynamics, Symbolic Dynamics, and Lyapunov Exponents 

While we will not prove here that the baker's map or the toral automorphisms are mixing 
systems, it is very instructive to sketch the lines of the proof for the baker's map. This will 
provide a simple example of a Markov partition, which is a useful construction in many other, 
and more general, contexts p7| , p8| . We begin by noting that any number in the interval [0, 1] 
can be expressed in a binary series, the dyadic expansion, as 

^ = T + 2^ + 2^ + ---' (11) 
where each of the can take on the values 0, 1, depending on x, of course. We can represent 
OC clS cLll infinite sequence of O'and I's as 

X = {ao,ai,a2,- ■ ■)■ (12) 

This representation is unique except for those fractions whose representations consist of a 
finite number of a's followed by an infinite number of O's or of I's. Such fractions have two 
equivalent representations, one with an infinite sequence of zeroes and one with an infinite 
sequence of I's. As these particular fractions form a countable set, we can always require 
that we use one of these representations for them consistently. In a similar manner we may 
represent y in [0, 1] as 

b-i 6-2 , 

y = ^ + ^ + --- or 

y = (6-i,6-2,---)- (13) 
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Combining these two representations, we see that any number in the unit square < x,y < 1 
may be expressed by 

(x, y) = {■ ■■ b-2b-i.aoaia2 ■■■), (14) 

where we have separated the x-sequence from the y-sequence by a "dot", and strung the 
y-sequence to the left, with the x-sequence to the right. We can clearly approximate any 
point in the unit square to an accuracy 2"^ by a finite sequence 

(x, y) ~ (b^Nb-N+i ■ ■ ■ 6-i.aoa-i ■ ■ ■ ctAf-i)- (15) 

Such an approximation is equivalent to locating the point somewhere in one of the small 
squares obtained by dividing the unit square into small regions by drawing vertical lines 
at intervals of 2^^, and similarly with horizontal lines. This partition of the unit square 
into much smaller regions, is an example of a Markov partition, because of the particular 
way in which the lines are drawn, as we explain below. The approximation to the point 
(x, y) consists in specifying the particular small region in which the point is located. This 
procedure for approximating a particular point in phase space, here the unit square, is a 
mathematical echo of the idea of coarse graining often used in statistical mechanics. 

The central feature that we now want to emphasize is that given the representation of 
the point {x,y) on the unit square by Eq. (0), its image, {x',y') under the baker's map 
becomes 

(x', y') = (■ ■ ■ 6_2&-iao.aia2 ■ ■ ■), (16) 

where all the members of the sequence have shifted one unit to the left, and, in particular, 
the number has moved past the "dot" into the y-sequence. Thus we have mapped a 
deterministic dynamical system onto something that looks like a "coin toss" experiment. 
A point on the unit square can be mapped onto a bi-infinite sequence of O's and I's, that 
is, onto a particular realization of a bi-infinite coin toss sequence, and the "dot" indicates 
the location of one particular moment in the sequence of tosses. The next toss will simply 
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be the next step in the process of generating the entire sequence, and corresponds, in the 
baker's map, to one iteration of the map! A coin toss experiment is, of course, a stochastic 
process, with a given probabihty p for obtaining a "heads" and q = 1 — p for a "tails" . Our 
abihty to map certain deterministic dynamical systems onto random, stochastic processes is 
the main point of this article! Of course the central question is to identify those systems for 
which such a mapping is possible. 

Now consider what happens to all of the points in the small square of order on a 
side, which we will take to be the set A in the Gibbs picture. We know that for all such 
points the values of b^^, b^^+i, ■ ■ ■ , b-i, ao, cti, ■ ■ ■ , aN-i will be the same. However, each of 
the additional, unspecified aiy+k, b-N-k', with k > —l,k'>0, can take on the values or 1. 
All of the points in the small square correspond to all possible values of these unspecified 
a's and 6's. After iterations of the baker's map, all of the specified values for the a's 
will have shifted onto the y coordinate, and the set of points in the original small square 
will be uniformly distributed along the x interval [0, 1]. After 2N iterates of the map, we 
will have lost track of the y coordinates as well, at least to the accuracy we have specified, 
and the points originally confined to our small square will be uniformly distributed over the 
entire unit square. Thus the system is indeed mixing. Note also that a similar circumstance 
would apply if the map were run backward, and the sequence shifted to the right past the 
"dot" at each step. Thus we can see an approach to a uniform distribution for both the 
"forward" and the "time reversed" motions. Consequently we can say that it is certainly 
possible for the ensemble distribution for a reversible dynamical system to show an approach 
to a uniform, equilibrium state for both forward and backward motions, provided we look 
at the distribution on a slightly coarse grained scale. 

A very similar analysis applies to the hyperbolic toral autormophisms, but the partition- 
ing of the unit square (or torus) should be done with lines whose directions and spacings 



are dictated by certain features of the particular automorphism p^ , p7| . These features will 
be determined by the directions of the stable and unstable manifolds, and by the Lyapunov 
exponents of the map, all of which we will discuss shortly. The representation of the trajec- 

12 



tory of a point on the unit square under the baker's map in terms of sequences of O's and I's, 
is an example of symbolic dynamics, whereby, trajectories are coded into sequences whose 
elements are chosen from a finite number of symbols (here or 1) The representa- 

tion of dynamics using such sequences can be very useful in analyzing and calculating the 
properties of dynamical processes in simple enough systems. For example, readers might 
convince themselves that the Cantor "middle third" set can be coded by similar sequences 
of two symbols. (Hint: Consider the map x' = 3x mod 1, and represent all numbers on 
the unit interval by a series in inverse powers of 3, with coefficients 0,1,2. The "middle 
third" Cantor set is isomorphic to all sequences where a 1 never appears, and the above 
transformation just maps this set onto itself.) 

Now a remarkable thing has just happened in our analysis of the baker map. We started 
with a set of points that were all within a distance e = of each other, and they spread 
out over the unit square. Consequently, the rates and directions of separation, or conversely 
of approach, of the images of two nearby points are certainly quantities of some interest 
for understanding the mixing process. For the baker's map, it is clear that the images of 
infinitesimally close points with the same y coordinate will separate in the x-direction, so 
that their separation, dn, after n steps will be 2"do, where their initial infinitesimal separation 
is do- However, the images of two infinitesimally close points with the same x coordinate 
will approach each other as dn = 2~"'dQ. The images of two infinitesimally close points that 
do not lie in a strictly vertical line will also separate exponentially, since the exponential 
separation in the x - direction will dominate the separation of the two points. Consequently, 
the images of any two infinitesimally close points will separate exponentially, except for 
a set of measure zero, namely those points with the same y coordinate. If we consider 
the time reversed motion, then points will separate in the y direction, approach in the x- 
direction, but the images of almost all nearby points will separate exponentially rapidly. The 
exponents that govern the rates of exponential separation or approach are called Lyapunov 
exponents We see that the baker's map has two Lyapunov exponents. In 2, — In 2. The 
fact that the sum of these exponents is zero is not accidental, it is a consequence of the 
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invariance of the Lebesgue measure on the unit square. Moreover, while the separation of 
the nearby points is exponential for a large number of iterations of the map and the rate of 
separation is given by the Lyapunov exponents on this time scale. However this exponential 
rate of separation cannot continue forever since the measure of the phase space is finite.. 
Eventually the separation will become large enough that the folding mechanisms of the baker 
map will take over and the two points will find themselves in very different regions of the 
unit square. In general we will find that exponential separation of trajectories in a bounded 
phase space cannot continue indefinitely, but that there is always a folding mechanism that 
keeps trajectories within the bounded region. 

Consider now the case of the hyperbolic toral automorphisms, Eq. (^, and let us use 
the Arnold cat map as an example. An elementary calculation shows that the 2x2 matrix 
given below Eq. (H) has the eigenvalues A± given by 

A. ^ (17) 

Notice that A_|_ > 1, A_ < 1, and the invariance of the Lebesgue measure on the unit torus 
requires that A+A- = 1. Here again we see that there is an expanding direction which 
is determined by the direction of the eigenvector corresponding to A+, and a contracting 
direction determined by the direction of the eigenvector corresponding to A_. The associated 
Lyapunov exponents which we denote by X± are given by X± = lnA±. Here again we note 
that the invariance of the measure on the unit torus requires that A+ + A_ = 0. Consider a 
typical point on the unit square and draw a set of lines through it such that one is in the 
direction of the expanding eigenvector and the other is in the direction of the contracting 
eigenvector. We will refer to these two lines as the expanding or unstable manifold and the 
contracting or stable manifold respectively. The images of two infinitesimally close points 
on the unstable manifold will separate exponentially, while the images of two close points 
on the stable manifold will approach exponentially [p],p!6|. 

Now we can return to the idea of a Markov partition mentioned at the beginning of 
this section. A Markov partition is a partition of the phase space into a finite collection 
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of small "parallelograms" with disjoint interiors and whose sides lie on stable and unstable 
manifolds, perhaps suitably extended, of points in the space. For the case of the baker's 
map, the parallelograms have vertical and horizontal sides, while for the Arnold cat map, 
the parallelograms have sides that lie along the eigen directions of the matrix below Eq. 
(^). The existence of a Markov partition for a dynamical system allows one to use symbolic 
dynamics to code the trajectories, and to use of the theory of Markov processes to analyze 
the time dependence of distribution functions defined on the phase space. For example, the 
solution of the Perron-Frobenius equation to be discussed in Section 4 is greatly facilitated if 
one can construct a suitable Markov partition for the system. The calculations described in 
Section 3.4 makes extensive use of the method of Markov partitions. Further details and a 
discussion of the use of Markov partitions to compute other quantities of dynamical interest 
such as Kolmogorov- Sinai entropies, to be discussed below, can be found in Refs. [|l^,|l^ . 



In order to show that the Lyapunov exponents are non-zero for both the baker map and 
the hyperbolic toral automorphisms we have had to calculate them, thus, given a dynamical 
system, it is not always obvious that it will have the positive Lyapunov exponents that are 
required for the exponential separation of trajectories. 

We can generalize the concept of Lyapunov exponents, stable, and unstable manifolds 
to higher dimensional systems and to flows, in addition to maps @]. Usually the only fun- 
damental difference between maps and flows is that flows typically have one zero Lyapunov 
exponent in the direction of the trajectory in phase space 0,^. Although the proof can 
sometimes be involved mathematically, the zero Lyapunov exponent in the direction of the 
trajectory can be understood by imagining two infinitesimally close points that lie on the 
same trajectory in phase space. If the dynamics of the system consists of free particle mo- 
tion punctuated by collisions that are instantaneous or almost so in comparison with other 
time scales of the system (the mean free time between collisions, say), then the two points 
will remain close over the course of their motion and their separation will certainly not be 
exponential. Furthermore, if the dynamics is consistent with an invariant measure, such as 
Hamiltonian dynamics, then the sum of all the non-zero Lyapunov exponents must be zero 
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as a consequence of the invariance of the measure. This suggests that the Lyapunov expo- 
nents should be defined in such a way as to be consistent with the invariance of the measure, 
which is the case in the two examples we have considered. It is worth pointing out that 
Lyapunov exponents for periodic trajectories, which have delta function invariant measures, 
may very well be different from those defined with respect an invariant measure defined on 
the entire phase space. One additional property of the non-zero Lyapunov exponents for a 
Hamiltonian system that is important is the symplectic conjugate pairing rule. That is, for 
a system with symplectic dynamics, the non-zero Lyapunov exponents, should there be any, 
must come in "plus-minus" pairs, with each pair of exponents summing separately to zero, 
independent of the values of the other pairs. This is a consequence of the symplectic form of 



Hamilton's equations of mechanics [^, and is not true for reversible systems that are not 
symplectic. We shall encounter such systems in the further sections. 



D. The Kolmogorov-Sinai Entropy 

Let us now look at some properties of the Arnold cat map in more detail. In Fig. 4, 
we show an initial set A which is located in the lower right hand corner of the unit square, 
and in Figs. 5, 6, 7, we show the evolution of this set after 2, 3, and 10 iterations of the 
map respectively (a similar set of figures can be found in As the number of iterations 

increases the set becomes longer and thinner such that at the third iteration the set has 
begun to fold back across the unit square, and after 10 iterations the set is so stretched 
and folded that it appears to cover the unit square uniformly. If we were able to increase 
the resolution of this illustration beyond the 10^ points used to generate it, we would see 
that this apparently uniform distribution is made up of very many, on the order of 10^, thin 
lines parallel to the expanding direction of the cat map, and very close together. Since the 
initial square is getting stretched along the unstable manifold, at every iteration we learn 
more about the initial location of points within the small initial set A. That is, suppose we 
can distinguish two points on the unit square only if they are separated by a distance 6, the 



16 



resolution parameter, and suppose further that the initial set has a characteristic dimension 
on the order of 5 0. We cannot resolve two points in the initial set then, but after a time 
t, the initial set will have stretched along the unstable direction to a length on the order of 
5exp(A+t), and we can easily resolve the images of points in the initial set. Thus as we look 
at the successive images of the initial set we are able to obtain more and more information 
about the location of points in the initial region, in fact, the information is growing at an 
exponential rate. The exponential rate at which information is obtained is measured by 
the Kolmogorov- Sinai (KS) entropy ||T|,3Jl6[| , hxS) and for our simple system, the cat map. 



hxs = In general, one finds that for a dynamical system of several dimensions, with 
positive Lyapunov exponents, and where all of the points are confined to a bounded region 
of phase space, then 

hKS = Y.K,, (18) 
i 

where the summation is over all of the positive Lyapunov exponents of the system. Eq. (18) 
is referred to as Pesin's theorem [^,0], and we mention that there is a highly developed 



theory for the KS entropy JTB|p7| ], which we cannot expand upon here. We mention again 
that the Lyapunov exponents and the KS entropy should be defined with respect to an 
invariant measure. Thus, there may be many sets of exponents for a single system, e.g., 
Lypaunov exponents defined on periodic orbits may differ from those defined with respect 
to the natural invariant, or SRB, measure, which will be discussed in Sec. 2.5. Pesin's 
theorem applies if hxs and the Lyapunov exponents are defined with the respect to the 
natural invariant measure. In the next section we will consider a situation where points can 
escape from a bounded phase space region, and where the KS entropy is less than the sum 
of the positive Lyapunov exponents by an amount that is equal to the escape rate of points 
from the bounded region. One might say that in this latter case the rate of stretching is 
slightly greater than the rate of folding. 
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E. Hyperbolic and Anosov Systems 



We have argued that both the baker's map and the hyperbohc toral automorphisms are 
mixing systems, and as a consequence, as simple models of dynamical systems, they show 
an approach to equilibrium. In fact we can map these simple reversible dynamical systems 
onto stochastic processes. The mechanisms responsible for this desirable behavior are: (1) 
the exponential separation of trajectories in phase space, characterized by positive (with 
corresponding negative) Lyapunov exponents with corresponding expanding and contracting 
directions; and (2) the folding of phase space regions during their time evolution due to the 
boundedness of the phase space, leading to a uniform distribution of points over the phase 
space, at least on a coarse grained scale. It is now time to formalize these properties so that 
we can see if the above mechanisms apply for more realistic systems. 

To do this we consider a general dynamical system with several degrees of freedom, with 
an associated phase space F and an invariant measure /i on the phase space. Let us write 
the equations of motion for the phase space variables, denoted by X as 

X=G(X), (19) 

where, typically, but not always, G is the appropriate derivative of the Hamiltonian func- 
tion with respect to the phase space variables. In order to consider the possible exponential 
separation of infinitesimally nearby trajectories, we consider the time evolution of a small 
displacement 5X in phase space between two arbitrarily close points |]5|,|32|. This displace- 



ment satisfies a linearized equation in the tangent space to T at the point X, 

*X.^?|51..X. (20) 

The solution to this equation in the tangent space has the form 

<5X4 = M(t,X)-X, (21) 

where M satisfies the equation 
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M(t,X) = ^^^-M(t,X). (22) 

The matrix M plays a special role in the discussion now, as it determines the dynamical 
evolution of the displacements in the tangent space. 

We define an Anosov dynamical system as a map or fiow with the following properties 
P JT6|J33|] (we consider fiows here, but our definition can be easily modified for maps): 

1) for almost every point, X, in the phase space F, there is a decomposition of the tangent 
space at X, Tr(X), into three subspaces, an unstable subspace Sx, a stable subspace £x, 
and a center subspace £x S:uch that 

TT{X) = £^®£'x®£x- (23) 

2) There are constants Cg, Cu, and A with Cg, Cu > 0, and < A < 1, such that: 

a) If 5X is in £x, then 

||M(t,X)-(5X|| <C,A*||5X||, (24) 

b) If 6X is in £^, then (for t > 0) 

||M(-t,X) -5X11 < C„A*||5X||, (25) 

c) The subspaces £x,£xj^x vary continuously with X. This means that any vector (5X 
can be written as 

5X = + SX'x + (5X^, (26) 

where each term is in the indicated subspace. Then each of the (5X-^ vary continuously with 
X. 

d) The various subspaces intersect transversely, without any tangencies. 

The center subspace contains the directions of motion with zero Lyapunov exponent, 
such as the direction tangent to the trajectory of the system in phase space, and any other 
directions associated with the macroscopically fixed constants of motion, such as the total 
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momentum, etc. Note that in condition b) above we considered the time reversed motion 
on the unstable manifold, and the condition is that small deviations from the orbit converge 
exponentially to zero for the time reversed motion, while for the stable manifold, the devia- 
tions approach zero exponentially in the forward direction. The transversality condition d) 
assures that there are no tangencies among the subspaces which would greatly complicate 
the description of the dynamics. 

As we will see in the next section, there are a number of circumstances of physical interest 
where we will need to consider invariant subregions of the full phase space. These regions are 
usually fractal attractors or repellers, to be defined and described in the next section, which 
have Lebesgue measure zero in the full phase space. It may happen that the dynamics, when 
restricted to such an invariant subregion still satisfies conditions a)-d) above. In such a case 
we say that the dynamics is hyperbolic on the subregion. An Anosov system, then, is one 
which is hyperbolic on the full phase space. 

Anosov systems of finite total measure have the properties that we need for equilibrium 
and non-equilibrium statistical mechanics, they are ergodic and mixing, with positive KS 
entropy. However with the exception of the simple models we have discussed already, we do 
not know if some of the most physically realistic systems are Anosov. Certainly hard disk or 
hard sphere systems are not Anosov, since the collision dynamics produces discontinuities 
in which one member of a pencil of nearby trajectories just includes a grazing collision 
involving two particles, but many of the other trajectories miss that collision altogether. 
However, Sinai and co-workers have shown that such systems still have many of the nice 



properties of Anosov systems [15,24]. In view of the difficulty in establishing whether a 



physical system is Anosov, Gallavotti and Cohen ||3^ have proposed a chaotic hypoth 



leszs. 



namely, that until one proves that a system of interest is not Anosov, one should assume 
that it is, and then calculate its dynamical properties based upon that supposition. Their 
reasoning is simply that had we waited for someone to prove that a given physical system is 
ergodic before applying the methods of equilibrium statistical mechanics to it, there would 
have been precious little progress in understanding the properties of equilibrium systems over 
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the last hundred years. Thus it would seem practical for physicists, at least, to compute the 
dynamical properties of systems by assuming that the systems are Anosov. We will adopt 
this attitude here, for the most part, but we will also treat the hard disk Lorentz gas in 
the later sections, and make explicit use of the discontinuous dynamics. We'll see that the 
failure of this system to be Anosov is not a serious handicap. 

We conclude this section with the statement of an important theorem due to Sinai, 
Ruelle, and Bowen, that is a generalization of the ergodic theorem to general hyperbolic 
systems, whether they be an Anosov system, or a system which is restricted to a repeller 
or an attractor. Suppose then that we have: (1) a hyperbolic system described by a flow 

= 5'((X) for almost all X in some invariant region TZ, and (2) 5'(X) is a continuous 
function of X. Then there exists a unique measure such that for almost all (with respect 
to Lebesgue measure) X in 7?. 

where the integrals on the right hand side of Eq. (^) are over the invariant region TZ. The 
measure that is proved to exist by this SRB theorem is called a SRB measure. In the case 
that TZ is the full phase space F, then the SRB measure is the microcanonical measure, and 
the SRB theorem is equivalent to the statement that Anosov systems are ergodic. However 
the theorem is much more general than that, and as we have said, it applies to hyperbolic 
attractors and repellers, as well. 

III. APPLICATIONS OF DYNAMICAL SYSTEMS THEORY TO TRANSPORT: 

REPELLERS AND ATTRACTORS 

A. The Escape-Rate Method 

In our discussion of the KS entropy, we argued, in effect, that if we have a closed hy- 
perbolic or Anosov system, the sum of the positive Lyapunov exponents is equal to the KS 
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entropy (Pesin's theorem, Eq. (|T8D)- Suppose now that we have a situation frequently en- 
countered in transport phenomena, where particles can escape from the system. Consider, 
for example, the diffusion of particles in a fluid, that has absorbing boundaries. In that case, 
particles that reach the boundary will be lost from the system. Here we argue that it is 
possible to apply dynamical systems theory to such a case, and that this application shows 
a deep connection between transport coefficients and the properties of chaotic dynamical 
systems. This connection was first made by Gaspard and Nicolis This is an appro- 



priate place to say that by a chaotic dynamical system we mean one that has a positive 
KS entropy, i.e., exponential separation of trajectories, and a bounded phase space so that 
folding takes place. 

First we consider the macroscopic description of such a diffusion phenomena. Suppose 
we have some macroscopic region of characteristic size L, much greater than any of the 
microscopic lengths that characterize the system. Suppose that the system consists of one 
moving particle and a collection of fixed scatterers, arranged in such a way that the moving 
particle is never trapped inside the system. Now suppose that the boundary of the system 
is absorbing, so that any particle that reaches the boundary will be absorbed, and removed 
from the system. The macroscopic description of this process is through the Fokker-Planck 
equation for P{f,t), the probability of finding the particle at point r at time t, which is 

^^ = DV^P(f,t), (28) 

supplemented by the absorbing boundary condition, P = on the boundary. (In this case the 
Fokker-Planck equation coincides with thediffusion equation.) Here the quantity of interest 
is the diffusion coefficient D. If we solve this equation and ask for the probability that the 
particle will still be in the system at time t, P{t) = J dfP{f, t) we find that P(t) = exp[— 7t], 
where the escape-rate 7 is 

7 = (29) 

where a is a numerical constant that depends on the geometry of the region of scatterers. 
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A remarkable fact is that there is also a microscopic expression for the same escape-rate 
in terms of the dynamical properties of the moving particle in the scattering region. To 
understand the microscopic formula we need to realize that although the moving particle 
will eventually escape the region with probability 1, there are an infinite number of possible 
trajectories for the particle whereby it never leaves the scattering region, i.e., it is never 
absorbed at the walls. The set of initial positions and velocities of the moving particle, that 
is, the set of initial points in the phase space of the moving particle, that lead to orbits 
which are entirely within the scattering region is called the repeller for this system, and we 
denote it by TZ. The repeller is typically a fractal set of Lebesgue measure zero in the phase 
space, but with a non-countable number of points. TZ will have a Hausdorff dimension which 
is slightly less than the dimension of the phase space. The escape-rate 7 can be expressed 
in terms of the dynamical properties of the trajectories that are entirely confined to the 
repeller as 



where the summation is over all the positive Lyapunov exponents, X^^iiJZ) for trajectories 
on the repeller, and hKs{TV) is the KS entropy for these trajectories P| JT7| , |52|P5| . Note that 
we have a system for which Pesin's theorem does not hold, but by a small amount of order 
L~^. To get some feeling for the origin of the escape-rate formula, though by no means 
a derivation, we return to our argument for the validity of Pesin's theorem ||^. We want 
to find the rate at which we are obtaining information about the location of the initial 
points on the repeller. As before, the stretching mechanism provides an exponential rate of 
information growth about the initial location of the point in phase space, but the probability 
that the system has not disappeared through the boundary is decreasing exponentially, too. 
Therefore, we should expect that the rate of information growth for points on the repeller 
is obtained by combining these two exponential rates as 



(30) 



(31) 
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or, equivalently, Eq. (^) above. Simple one dimensional maps which illustrate the derivation 
of the escape-rate formula, and exhibit the structure of the fractal repeller are described in 
Refs. As an example the reader might consider the map 

x' = 3x for < X < 1/2 

- - (32) 

= 3a; - 2 for 1/2 < a; < 1 

and suppose that points mapped outside the interval [0, 1] have escaped. For this map the 
fractal repeller is the middle third Cantor set, the escape rate is 7 = ln(3/2), the Lyapunov 
exponent on the repeller is In 3, and the KS entropy is In 2. These results can be understood 
by realizing that the map stretches all intervals by a factor of 3, accounting for the Lyapunov 
exponent, and that dynamics on the repeller can be coded by sequences to two symbols, each 
symbol appearing with equal probability, accounting for the KS entropy on the repeller. 

If we now combine the macroscopic expression for the escape-rate, Eq. (p9|) with the 
microscopic one, Eq. (pO]), we obtain an expression for the coefficient of diffusion, a 
transport coefficient, in terms of the dynamical properties of the repeller. 



D = lim — 

L^oo a 



(33) 



where we have taken the thermodynamic limit to ensure a result that does not contain 
finite size effects. Eq. (|33D is due to Gaspard and Nicolis |T^. Gaspard and Dorfman have 
extended this method to apply to the other transport coefficients, such as the shear and 
bulk viscosities, and thermal conductivity of a fluid, as well as for chemical reaction rates 
||37| . When applying the escape-rate formalism to systems like the Lorentz gas, for example, 
one usually flnds that the Lyapunov exponents and KS entropy for the repeller are equal 
to their inflnite system values plus very small corrections of order L~^. Thus the transport 
coefficients are contained in these small corrections to the infinite system values, and the 
transport process is "coded" in the fractal structure of the repeller. 

The escape-rate method has been applied to compute the properties of the fractal re- 
peller for a number of model systems, including the multibaker model for diffusion in one 
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dimensional systems [^], the two dimensional periodic Lorentz gas at sufficiently high den- 
sity that the free path length of the moving particle is small compared to the dimensions 
of the system p6|,p9|, to the random Lorentz gas at low densities EO|,ffT|, but still with a 



mean free path small compared to the size of the system, and to Lorentz lattice gases |^ 
In these cases the Lyapunov exponents and KS entropies on the repeller differ from their 
values in the thermodynamic limit, by terms of order L~^. The chief difficulty in using the 
escape-rate method as a method to compute transport coefficients is that it is as hard or 
harder to compute the dynamical quantities, particularly hKs{T^) as it is to compute the 
transport coefficient directly, using kinetic theory or other methods. It would be extremely 
valuable, for example, to have analytic methods to compute hxs{T^) directly rather than 
having to compute 7 and \^^i{7l) and using the escape rate to obtain the KS entropy on 
the repeller, as one has to do in the analytic studies of the random Lorentz gas. 

B. The Gaussian Thermostat Method 



Another way to relate transport coefficients to dynamical quantities, in this case Lya- 
punov exponents, was developed as a result of efforts to simulate transport processes on the 
computer using molecular dynamics techniques. It was found early on that the simulations 
of viscous flow were plagued by the viscous heating of the fluid. To deal with this Evans, 
Hoover, Nose, and co-workers developed a thermostatting method that keeps either the ki- 
netic or total energy constant in the fluid undergoing shear [1^. Although the thermostat 
destroys the symplectic, Hamiltonian structure of the dynamics, we get as compensation, 
so to speak, a useful and interesting connection between the transport coefficients in the 
thermostatted system and the Lyapunov exponents for the thermostatted dynamical sys- 
tem, assuming the system approaches a non-equilibrium steady state. The "destruction" of 
the symplectic structure is something of an overstatement. Liverani and Wojtkowski |^ 



have shown that these thermostatted systems are conformally symplectic, with useful con- 
sequences for the Lyapunov spectrum, and Dettmann and Morriss have shown that the 
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thermostatted dynamics can be mapped onto Hamiltonian dynamics with unusual canonical 
position and momentum variables. We refer to their papers for details. 

We illustrate the method again for a Lorentz gas with a particle moving among hard 
disk or sphere scatterers P,|9|, |45|J46|] . We suppose that the scatterers are arranged randomly 



in space or in a regular configuration with a finite free path for the moving particle. We 
also provide the moving particle with a charge q and suppose that it is acted upon by an 
external electric field E, in addition to the scatterers. If there were no thermostat, then 
the average kinetic energy of the moving particle would increase steadily with time, since 
the collisions do not affect the kinetic energy, but the field does. To counter this average 
increase in kinetic energy, we introduce a "thermostat" which keeps the kinetic energy of 
the moving particle constant between collisions with the scatterers. The equation for the 
motion of the particle between collisions is given by 

f = p 

'p = E — ap, (34) 

where we have set both the mass, m, and the charge, q, of the moving particle equal to 
unity. Here a is a function of the momentum and electric field that is fixed by the condition 
that the kinetic energy be constant, i.e. p-p = 0. Thus 

a = (35) 

These equations of motion are supplemented by the equations for elastic collisions of the 
particle with the scatterers, 

p' = p — 2{n ■ p)h, (36) 

where p' is the momentum of the particle after collision, and n is a unit vector in the 
direction from the center of the scatterer to the point of contact with the moving particle at 
the instant of collision. These equations of motion define a reversible (under p —>■ —p, f ^ r, 
and t —t), non-Hamiltonian system in which the phase space volume is not conserved. 
This latter remark follows from the observation that 
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|:+|. (37) 

where d is the number of spatial dimensions of the system. 

These equations have a number of remarkable consequences. Computer simulations show 
that the system develops a steady state, and that in this steady state the average value of 
a is positive, (a)^^ > 0, as expected if the thermostat is to keep the system at constant 
kinetic energy p5|j47|P8|] . Now if the phase space volume is not conserved, but decreases on 



the average, but the system still settles into a steady state, at least within the resolution of 
the computer experiment, then it may be heading to a fractal attractor, of lower dimension 
than the phase space dimension, here, 2d — 1. We will give a simple example of a system 
that does just this in a moment. Moreover one may define a Gibbs entropy, 5*^ for this 
system by 

Sg = -kBj J dfdpfir, p, t) [In /(r, p, t) - 1] , (38) 

where we have assumed the existence of a phase space distribution function, f{f,p, t), for the 
moving particle. If this function exists and is differentiable, then it satisfies the conservation 
equation 

^ + V.^ ■ (/f) + Vp^ ■ im = 0. (39) 

We now use this conservation equation to compute the time rate of change of the Gibbs 
entropy due to the thermostat [Q. Here we suppose that the Gibbs entropy of the system 



does not change with time if the thermostat were not present, as is true for systems whose 
distribution functions satisfy the usual Liouville equation. Now by assuming that the dis- 
tribution function vanishes at the boundaries (in space and momentum) of the system, we 
find that 

^^ = -ks{a){d-l), (40) 

where the angular brackets denote an average with respect to the phase space distribution 
function /. This result that the entropy decreases with time can be understood, to some 
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extent, by noting that if the system is heading toward an attractor it is getting locahzed into 
a more restricted region of phase space with a concomitant decrease of the Gibbs entropy. 
The conservation equation, Eq. (|39|), has yet another consequence of some considerable 
interest, namely, we express / as f{f,p,t) = 1/V{f,p,t), where V is the volume of a small 
phase space region about {f,p) where the system is located at time t. Then the equation 
for f,f = {d — l)af, easily obtained from Eqs. (|37| , 39), leads to 

dlnVjt) 

; = —(a — l)a or 

at 

/dlnV{t)\ . 

Since the rate of change of small volume elements in phase space is governed by the sum of 
the Lyapunov exponents. 



y(r, p, t) ~ exp 



(42) 



where we may imagine that the Lyapunov exponents depend upon the phase space point, 
and the sum is over all of the exponents, not just the positive ones. From this it follows that 

^d-l){a) = -(^Y.Ur,P)y (43) 

Therefore, we can relate the average friction coefficient to the average value of the sum of 
the Lyapunov exponents 0^ . 



We now push this analysis into the realm of transport theory by returning to the calcula- 
tion of the rate of change of the Gibbs entropy. In a non-equilibrium steady state, the rate of 
decrease of the Gibbs entropy must be at least matched by an increase in entropy of the heat 
reservoir that is removing the heat generated by the dynamical processes in the system. If 
we identify this positive rate of entropy production with the irreversible entropy production 
required by irreversible thermodynamics aE'^/ksT, where a is the coefficient of electrical 
conductivity, T is the thermodynamic temperature, and is Boltzmann's constant, we find 
that 



'-^'^xX (44) 
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Eq. is the main result of this analysis [0. It shows that a transport coefficient, 

in this case the electrical conductivity, is proportional to the average rate of phase space 
contraction as measured by the sum of all of the Lyapunov exponents. We will comment 
in the final section upon the obviously problematic issues concerning the use of entropy 
production arguments here. 

For small fields the electrical conductivity of the moving particle and its diffusion co- 
efficient in the Lorentz gas are directly related by a simple factor, D = [{p'^/{q'^Tn)]a, and 
Eq. then provides another expression for the diffusion coefficient in terms of dynamical 
quantities, the sum of all of the Lyapunov exponents of the system. Similar expressions can 
be obtained for other transport coefficients. The coefficient of shear viscosity, in particu- 
lar has been studied in great detail for particles that interact with short ranged repulsive 
potentials, i.e. WCA particles |[T8|j49[ . 

The evaluation of these expressions for transport coefficients appears to be formidable 
since one has to determine the complete Lyapunov spectrum for the thermostatted system 
in an external field. This situation has been simplified to a great extent by the observation, 
and in some cases the proof P5| , ^ , |5(]| , of a conjugate pairing rule for these thermostatted 
systems. That is, the non-zero Lyapunov exponents can be ordered in conjugate pairs, 
Aj, say, such that the sum of each conjugate pair is the same for all conjugate pairs. 
Consequently, the sum of all of the Lyapunov exponents is equal to the product of the number 
of conjugate pairs and the sum of one conjugate pair. This is of course a generalization of the 
conjugate pairing rule for symplectic systems, where the sum is zero. The conjugate pairing 
rule for thermostatted systems has been observed in computer simulations, and has been 
proved analytically for a number of systems, provided the thermostat keeps the total kinetic 
energy p3| , |50| , rather than the total energy, kinetic plus potential, constant. Of course for 
hard sphere type systems, there is no difference between the kinetic and total energies. 
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C. A Simple Map with an Attractor 



In order to see how a fractal attractor might form in the phase space for a thermostatted 
system we turn once again to a simple two dimensional map. Here we construct a map that 
has some of the features that we expect to see in a thermostatted Lorentz gas, for example. 
That is, we consider a map with reversible, hyperbolic dynamics, but allow for a phase space 
volume contraction in part of the phase space. Such a map is provided by a map $ of the 
unit square onto itself given by 

y) = {x/l,ry) for 0<x<l 

(45) 

= {{x — l)/r,r + ly)) for / < a; < 1, 

where l,r > 0,1 r, and I + r = 1. This map is illustrated in Fig. 8. One can easily 
calculate the positive and negative Lyapunov exponents for this map and they are 

A+ = /In^ + rln-, (46) 
/ r 

A_ = Z Inr + r In/, and (47) 

A+ + A_ = (/ - r) In y < 0. (48) 

Here the equality holds in the last equation only if / = r = 1/2. The SRB theorem tells us 
that the time average of any continuous function defined on the unit square will approach 
an ensemble average taken with respect to the appropriate SRB measure. Some reflection 
will convince the reader that the SRB measure is smooth in the expanding, or x, direction 
but fractal in the contracting, or y, direction. The details of this and related SRB measures 



are described in Ref. [^. We say that the system has evolved to a fractal attractor with a 
smooth measure in the x direction and fractal in the y direction. This attractor is invariant 
under the map $ since the limiting form of the set is not changed by the map, or for that 
matter its inverse, which can easily be constructed. Another interesting point about this 
map $ is related to its reversibility property. The map has exactly the same Lyapunov 
exponents as the map $. However the SRB measure for the inverse map is smooth in 
the expanding y direction but fractal in the contracting x direction, and the time reversed 
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attractor is also invariant under the two maps, $ and its inverse. Sometimes we call this 
pair of invariant sets an attractor with a corresponding repeller. Depending on the direction 
of the time, one of the two invariant sets is an attractor, and the other is a repeller. 



D. Fractal Forms for Diffusion Coefficients 

Our discussions in this section have been largely formal. To conclude this section, we will 
consider the case of deterministic diffusion in one dimension under the action of a simple, 
piecewise linear map, such as that illustrated in Fig. 9. This map has the general form 
Xn+i = M{xn), where M{x) is a piecewise linear function of x, and satisfies the condition 
M{x + !) = ! + M{x). In the interval < a; < 1, M{x) is given explicitly by 

M(x) = ax for < s < 1/2 

" " (49) 
= ax + {1 - a) for 1/2 < x < 1, 

where the slope of the map a satisfies the condition a > 2, which is necessary for diffusion 
to take place at all. R. Klages studied this and similar maps for his Ph. D. work The 



diffusion coefficient could be obtained by mapping this system onto a Markov process using 
a one dimensional version of Markov partitions. All of the appropriate details are given in 
Klages' dissertation and in Refs. pSj^. Here we will consider the shape of the diffusion 
coefficient, D, a.s a function of the slope a for a > 2. The values of D for even integer a 
can easily be found by mapping this process onto a simple random walk on a line with a 
non zero probability, depending on a, of staying at the same site. For odd integer a, the 
problem is not much harder and D can also be obtained easily. The method of Markov 
partitions gives D for a dense set of values of a on the real line, and this is used to give the 
general structure of the dependence of D upon a. This dependence is illustrated in Fig. 10. 
There we see that D is a fractal function of a with quite a rich fractal structure. This rather 
surprising structure shows that transport coefficients are not always simple functions of the 
parameters of the system. Further studies on models of this type are underway by Klages 
|55| and by J. Groeneveld |^ . 
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We have established some interesting relations between dynamical and transport quanti- 
ties and showed that fractal structures in the microscopic phase space have properties that 
are directly related to macroscopic transport properties of the system. In the next section 
we look at questions of the dynamical foundations of irreversible kinetic equations and show 
how such equations can be used to compute, among other things, Lyapunov exponents and 
KS entropies, for the Lorentz gas, as an example. 

IV. THE DYNAMICAL FOUNDATIONS OF KINETIC EQUATIONS 

Two ideas have been developed in the previous sections which seem to be central to an 
understanding of the dynamical origins of irreversible phenomena in fluids. In particular, 
we can now isolate some of the key features that must be taken into account when one tries 
to understand the efficacy of stochastic equations such as the Boltzmann transport equation 
for describing irreversible processes in gases. Briefly stated, these two central ideas are: 

(1) One can, for Anosov systems and probably with suitable modifications for hard sphere 
systems as well, separate the tangent space at a particular point in phase space and, in fact, 
phase space itself, into expanding, contracting and center manifolds. The expanding and 
contracting manifolds exchange behavior on the time reversed motion. 

(2) Measures tend to be smooth in the unstable, or expanding, directions, and fractal in 
the stable, or contracting, directions. 

Therefore one can imagine the following scenario for the derivation of an irreversible 
equation from a dynamical analysis. Consider some initial ensemble distribution in phase 
space that is a measureable function of the phase space variables with respect to the mi- 
crocanonical measure, say. To be specific consider an initial distribution which is unity on 
a certain set A of small measure and zero elsewhere. In the course of time, this set will be 
stretched along the unstable directions, becoming more and more uniformly distributed in 
these directions, but forming more and more of a fractal structure in the stable directions. 
If then, we project the distribution function onto the unstable directions, say by integrating 
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over the stable directions and thereby obtaining a reduced distribution function, we ought 
to see the approach to a uniform distribution function in the projected variables. 

To make this argument less abstract and more transparent, we consider its application 
to our familiar models, the baker map B J57| , |58[] and the Arnold cat map. To begin we will 
need the version of Liouville's equation appropriate for maps that that evolve at discrete 
time intervals, called the Perron- Frobenius equation ||T|j30( . 



A. The Perron-Frobenius Equation 

We consider a map of some region R onto itself. To be definite we take R to be two 
dimensional, and the map to be of the form 

(x', y') = <l>(x, y) = (<l>i(x, y), <l>2(x, y)). (50) 

We consider R to be our phase space, and we suppose there is some phase space distribution 
evolving from some initial distribution on R denoted by pQ{x,y). Then after n iterations 
of the map, a new distribution function, pn{x,y), is obtained which satisfies the recursion 
equation 

p„(x, y) = J^J dx'dy'5{x - y'))5{y - $2(x', y')) ■ 

Pn-i{x',y'). (51) 

This recursion equation, the Perron-Frobenius equation, is self-evident provided the delta 
functions are not to be evaluated at possible discontinuity points of the distribution function. 
The delta functions can be evaluated in terms of the pre-image points of {x,y), and the 
Jacobian of the map $ at these pre-image points. The examples to which we apply this 
equation are simple area preserving maps on the unit square for which the Jacobian of $ is 
simply unity, but more general cases can be treated as well. 
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B. The Baker's Map 



To apply the Perron-Frobenius equation to the baker's map, we take R to be the unit 
square, and the mapping $ to be given by Eq. (^. An elementary calculation leads to the 
recursion equation 

p^{x,y) = pn^i{x/2,2y) for < y < 1/2 

(52) 

= p„_i(£±i,2y-l) for l/2<y< 1. 

For this map the unstable direction is the x-direction, and we can define a reduced 
distribution function that only depends on x by integrating over the y variation of pn{x,y). 
We therefore define Wn{x) by 

Wn{x) = f dypn{x,y) 
Jo 



/■V2 fl X + 1 

/ dypn-i{x/2,2y) + dyp„_i(— — , 2?/ - 1 

JO Jl/2 2 



1/2 

W^n-l(|) + W^n-l(^; 



(53) 



This equation can be considered to be a model "kinetic" equation since it is obtained from 
the discrete form of Liouville's equation by integrating over the y variation. The reader may 
also notice that Eq. ( ^3]) is itself the Perron-Frobenius equation for the map x' = 2x mod 
1. It is easy to see that Wn = 1, or any non-zero constant, is a solution of this equation, 
and we require that p„ and Wn be non-negative so that they can represent probability 



distributions. Moreover there is an iZ-theorem associated with Eq. (|53D , very similar to 
Boltzmann's if-theorem. That is, we define Hn = Jq dxWn{x) In Wn{x) , and elementary 
inequalities based upon the observation that a straight line connecting two points on the 
curve z = ulnu lies below the curve show that Hn < Hn-i- The equality sign holds only if 
Wn is a constant. Finally, Eq. (|53| ) can be solved if Wo{x) is a measurable function of x, and 
any arbitrary, normalized initial distribution will approach 1 as n — ^ oo. It is important to 
note that we have done nothing more than integrate the Perron-Frobenius equation for this 
map over the coordinate in the stable direction, assuming only that the initial distribution 
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function is well behaved. As the time increases, the reduced distribution function becomes 
an increasingly smoother function of x, finally reaching an equilibrium distribution, in a 
monotonic, irreversible manner. Now if we were to start with the same initial distribution 
function po{x,y), but follow the time reversed map, then the unstable direction is parallel 
to the y axis, and the reduced distribution function would be obtained by integrating the 
Perron-Frobenius equation for the time reversed motion over x. The resulting equation 
would be identical to Eq. (^3|), with x replaced by y. The reversibility of the underlying 
equations of motion is still preserved but irreversible equations are obtained by selecting the 
direction of time and projecting the full distribution function onto the unstable manifold. 
The reader is also invited to see what happens if the distribution function is projected onto 
the stable manifold, for the baker's map. The paper by Tasaki and Gaspard |^ should 
prove useful for this analysis. 



C. The Arnold Cat Map 

As an extension of the ideas just discussed we consider now the Arnold cat map. The 
analysis of the corresponding Perron-Frobenius equation is complicated by the fact that the 
unstable and stable directions are not oriented along the x and y axes respectively, but are 
rotated by a fixed angle. Instead of working out the mathematics let us just look at the 
map on the computer. We will be interested in the reduced distributions projected onto 
the X-axis or onto the y-axis. This is a little closer to what we need to understand the 
Boltzmann equation since for a dilute gas with particles we do not know the directions 
of the stable and unstable manifolds in phase space, but we do consider a projected or 
reduced distribution function, namely the single particle distribution function obtained by 
integrating the Liouville distribution over the phases of all but one particle. 

We start with the same initial distribution function for the Arnold cat map as illustrated 
in Fig. 4, that is, where all of the distribution is concentrated in the lower left corner of 
the unit square. In Fig. 11 we plot the distribution function projected onto the x-axis, for 
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various times starting with a step function at t = 0. Note that this function also becomes 
smooth with time and appears to have reached equihbrium after four steps. Now consider 
the same map but project the distribution function onto the y-axis. this is illustrated in Fig. 
12. Exactly the same things happen. This reduced distribution function also approaches an 
equilibrium value after a ten time steps or so. One can also show that if-functions defined in 
terms of either of these distribution functions decrease monotonically in time. If one reverses 
the motion, then very similar things will happen: both of the reduced distribution functions, 
whether projected on the x oi y axes will approach equilibrium. Only if we project somehow 
onto the stable direction will we not see an evolution to a smooth equilibrium distribution. 

We conclude from a study of these maps that the approach of a reduced distribution 
function to a smooth equilibrium value depends only on the construction of a reduced distri- 
bution function that is obtained by projecting the full distribution function onto a direction 
that is not orthogonal to unstable directions in phase space. Of course this is really a con- 
jecture. It is an important and open problem to work this out in detail for more realistic 
systems. Furthermore, we might be asking too much of realistic systems that this picture be 
realized in essence for them. Instead only much weaker properties may really be necessary 
for the variables of physical interest, such as the pressure exerted by a gas on the walls of 
the container, to show an approach to equilibrium. However, for Anosov systems, at least, 
where there is a very clear decomposition of the entire phase space into stable, unstable, 
and center manifolds, the picture sketched above is likely to hold. 

D. The Random Lorentz Gas 

In this subsection we briefly indicate how the Boltzmann equation itself may be used 
to calculate the Lyapunov exponents of a simple model of a gas, the hard disk Lorentz 
model PO| , p| , ^ . To do this we combine the ideas of Boltzmann with those of Ya. G. Sinai 
p!5| , thereby suggesting the existence of a deep connection between "molecular chaos" - 
the stochastic hypothesis that underlies the Boltzmann transport equation- and dynamical 
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chaos, which shows that stochastic-hke behavior is possible even for deterministic mechanical 
systems. 

Consider a collection of hard disks of radius a placed at random on a plane with number 
density n, such that na^ « 1. The moving particle always travels with the same speed, 
V and makes elastic collisions with the scatterers. To calculate the Lyapunov exponent we 
consider two trajectories on the constant energy surface that are infinitesimally close to 
each other, but separating, nonetheless. We consider the separation of a diverging bundle 
of trajectories in position space, since if this separation grows exponentially, so will the 
separation in velocity space, since both have to grow with the same exponential. We suupose 
without loss of generality that if we follow the trajectory bundle backward in time all the 
trajectories go through a common point of intersection. The separation of two trajectories 
in the bundle can be expressed in terms of a radius of curvature, p, which is the distance 
from the present position of the trajectories to the point of intersection. If we denote the 
distance between the two trajectories by A, one finds that (see Fig. 13) 

This equation has the simple solution 



It now follows immediately, from the fact that this system is ergodic that the positive 
Lyapunov exponent, A+, is given as 



where the brackets denote an ensemble average. Therefore we need to determine the ensem- 
ble distribution for the radius of curvature. This is the point where the Boltzmann equation 
becomes useful. Let us consider an "extended" distribution function, F{f,v, p,t), which 
includes the position of the moving particle, r, its velocity, v the time, t, and the radius of 
curvature, p, as variables. In a sense this is a two particle distribution function since the 




(55) 




(56) 
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separation of two trajectories is included as one of the variables. Now we know how r*and 
V change during free motion and at a collision with a scatterer. The radius of curvature p 
grows linearly with time during the free motion as p{t + dt) = p{t) + v dt, and changes from 
a precoUision value p~ to a post collision value p"*" at a collision, where 

p+ p a cos 

where is the angle of incidence at collision |jl5|. Typically p~ is on the order of the mean 



free path between collisions, and p'^ is always less than or equal to a/2. 

Using standard methods of kinetic theory one can derive the following equation for 
F{r,v, p,t), the extended Lorentz-Boltzmann equation 



dt^^-^^'d-p 



F{f, V, p, t) = -uF{f, V, p, t) 



, /ON yif^,/ I. f (acos0)/2 

+ (z//2) / d(f) dp' cos (j)6\p ^ " 



■k/2 Jo \ 1 + (acos0)/(2p')y 

xF{f,^,p',t), (58) 

and v' = V — 2{h ■ v)h , as in Eq. (^), and u = 2nav is the average collision frequency for 
the moving particle. This equation can be solved easily for an equilibrium system where F 
does not depend on r or t. The details of the derivation and the solution are given elsewhere 
0], but here we give the final result 

A+ = 2nav{l -C - \n{2na'^)), (59) 

where C is Euler's constant. We emphasize the point that not only does dynamical systems 
theory allow us to understand, to some extent at least, the dynamical origins of kinetic the- 
ory, kinetic theory in turn can be used to compute important quantities needed to show that 
the ideas we have been discussing are indeed relevant for our understanding of irreversible 
processes in fluids. 
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V. CONCLUSIONS 



Our excursion into the dynamical foundations of the kinetic theory of gases has provided 
us with a very stimulating and suggestive picture of irreversible processes. If we can show 
that a typical system like a gas of hard spheres or WCA particles is indeed an Anosov 
system, then many striking consequences are immediate. In particular, the phase space 
has a tangent space almost everywhere which can be decomposed into unstable, stable, and 
neutral subspaces. Measures and distribution functions become smooth with time along the 
unstable directions, approaching equilibrium values as the time gets very large compared to 
characteristic microscopic times. The reversibility of the equations of motion reflects itself 
in the interchange of stable and unstable directions under time reversal, so that equilibrium 
states appear in the time reversed motion as the distribution function becomes smooth along 
the unstable directions of the time reversed motion. 

If this picture is correct then we can relate microscopic dynamical quantities such as 
Lyapunov exponents and KS entropies to macroscopic quantities such as transport coeffi- 
cients. Here we illustrated this connection using the escape-rate formalism, and the method 
of Gaussian thermostats. However, these are only two of a number of useful methods for 
making this connection. For example, methods based on periodic orbit expansion or Ruelle- 
Pollicott resonances are under very active study at the present time [^,^ . 

We conclude with a few remarks: 

1) We have presented a picture here of how things might be for a typical system of interest 
to those applying kinetic theory methods to compute transport properties. It is not known 
whether this picture is indeed correct. We must study a number of systems of increasingly 
more realistic structures in order to get deeper insights into this question. Progress is being 
made in this direction using both computer and analytical studies of a number of different 
systems. 

2) We know very little about the complicated fractal structures that underlie transport 
processes in fluids, i.e., the attractors and repellers that we have discussed earlier. Only 
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for simple two dimensional maps do we have any good intuition about these fractals. Even 
higher dimensional maps would provide useful examples for more complicated systems. 

3) We have not mentioned many aspects of dynamical systems theory that are relevant for 
a further analysis of the topics discussed here. In particular, the thermodynamic formalism of 
Sinai, Bowen and Ruelle |H|,pT| provides a close, but often very formal, connection between 



dynamical systems theory and equilibrium statistical mechanics. This connection is surely 
not accidental, and can be very helpful for understanding the dynamical foundations of 
statistical mechanics, in general. 

4) The reader may have been surprised by the appearance of a negative entropy pro- 
duction in the discussion of the Gaussian thermostatted systems in Sec. 3.2. This negative 
sign is really not mysterious, since we are gaining more information about the system as 
its phase space trajectory becomes more and more localized on an attractor. In equilib- 
rium thermodynamics one can reduce the entropy of a gas by applying work in a reversible, 
isothermal compression. However, the entropy of the universe stays constant when one takes 
into account the entropy change of the thermostat that works on the gas. Here, similarly, 
one has to consider the system plus the thermostat in order to make sense of the entropy 
production. In a steady state the total entropy production must be zero, so the negative 
entropy production of the system must be matched by a positive entropy production in the 
thermostat. 

A number of papers have been written recently which discuss this topic in more detail. 
Ruelle has proved that the entropy production by the thermostat must be strictly positive 
||62|| . Tel, VoUmar and Breymann have discussed the entropy production for a simple model 
based upon the baker map from the point of view of coarse graining the phase space |]63| , |64 



Here the point is that we are unable, experimentally, to follow the localization of the ther- 
mostattes system onto the attractor because we are limited to the resolution of our observing 
devices. Therefore beyond a certain point we will not see the entropy of the thermostatted 
system decrease. Instead we will see the entropy of the coarse grained, observed, system 
increase as the microscopic processes take place on a scale that is too fine for our measuring 
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devices. In the Tel, Vollmer, and Breymann analysis the positive entropy production is 
taken to be the difference between the information available in a coarse grained description 
where nothing is changing beyond a certain scale and the information available in a complete 
microscopic description where one can follow the trajectory onto the attractor. There still 
needs to be a study where one connects this idea of coarse graining to a physical descrip- 
tion of a thermostat and shows that including the entropy production in the thermostat is 
equivalent to coarse graining the phase space of the thermostatted system. 

5) P. Gaspard has discussed entropy production for a simple reversible system which 
consists of a chain of baker's maps coupled in such a way that a density gradient may be 
established and maintained. He shows that the positive entropy production associated with 
this process is connected to the fractal structure that develops in the system as the steady 
density gradient is established. The phase space density is not a different iable function of 
the phase space variables, and one can only define a coarse grained entropy for the system. 
Gaspard shows that this coarse grained entropy is positive an its production has the form 
required by irreversible thermodynamics. 

6) We have not mentioned quantum mechanics at all. It seems inconsistent with our 
physical understanding of matter to restrict our attention exclusively to classical systems. 
The quantum versions of the ideas discussed here are still in the early phases of development 
and we refer the reader to the literature for further details ||66|. This is an area where even 
our understanding of even the simplest systems is not entirely secure. 

To conclude, there is a lot of work still to do in order to undertand in detail the chaotic 
foundations of transport theory and to provide a clear microscopic explanation of all of the 
phenomena that we associate with irreversible processes in fluids. 
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FIGURE CAPTIONS 

Figure 1. The tent map on the unit interval < x < 1. 

Figure 2. The baker's map on the unit square < x, y < 1. 
Figure 3. The Arnold cat map on the unit square. 

Figure 4- The initial set A is confined to the lower left corner of the unit square. The 
dynamics of the points in this set is governed by the Arnold cat map. 

Figure 5. The evolution of the set A after 2 iterations of the Arnold cat map. 

Figure 6. The evolution of the set A after 3 iterations of the map. 

Figure 7. The evolution of the set A after 10 iterations. The initial set A consisted of 10^ 
points, and the continuous nature of the initial set is no longer preserved. With more points, 
this evolved set would appear to be a set of closely spaced parallel lines, nearly convering 
the unit square uniformly. 

Figure 8. A simple map on the unit square with an attractor. The map is given by Eq. 
(45), and the areas of regions I and II individually are not preserved by the map. 

Figure 9. The one-dimensional piecewise linear map given by Eq. (49). Here a > 2. 

Figure 10. The diffusion coefficient D as a function of the slope of the map a, for the 
map in Figure 9. Curve (a) is the function over the range 2 < a < 8. Curves (b)-(f ) show the 
diffusion coefficient at various magnifications. The error bars are too small to be noticeable 
on these graphs. 

Figure 11. The x-distribution function for the Arnold cat map at iterations n — 
0,1,2,3,4, showing that the distribution becomes nearly uniform after 4 iterations. The 
initial condition is the same as in Figure 4. These curves are affected by a small computer 
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generated error. 

Figure 12. The y-distribution function for the Arnold cat map at the same iterations as 
in Figure 11, for the same initial conditions. 

Figure 13. The growth of the radius of curvature between collisions. 

Figure I4. The change in the radius of curvature at collision. 
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